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Abstract 

We present a direct reduction from fc-player games to 2-player games that preserves approximate 
Nash equilibrium. Previously, the computational equivalence of computing approximate Nash equi- 
librium in fc-player and 2-player games was established via an indirect reduction. This included a 
sequence of works defining the complexity class PPAD, identifying complete problems for this class, 
showing that computing approximate Nash equilibrium for fc-player games is in PPAD, and reducing 
£N| ' a PPAD-complcte problem to computing approximate Nash equilibrium for 2-player games. Our di- 

rect reduction makes no use of the concept of PPAD, thus eliminating some of the difficulties involved 
in following the known indirect reduction. 

H" 

^ ! 1 Introduction 

Q , This manuscript addresses the computation of Nash equilibrium for games represented in normal form. 
It is known that for 2-player games this problem is PPAD-complete |CD06b| . and for k players it is in 
PSPACE |EY07| . Moreover, for sufficiently small e, computing e- well-supported Nash equilibrium for 
2-player games remains PPAD-complete |CDT06| . and for k players it is in PPAD |DGP09J . It follows 
qq | that, for appropriate choices of e, e- well-supported Nash in fc-player games reduces to e- well-supported 
Nash in 2-player games. However, this chain of reductions is indirect, passing through intermediate 
notions other than games, and also rather complicated. 

O ' 

(^ • In this manuscript we present a direct, "game theoretic" polynomial-time reduction from fc-player to 

2-player games. In our reduction, every pure strategy of each of the k players is represented by a 
corresponding pure strategy of one of the 2 players. Previously, a direct reduction preserving exact 
Nash equilibrium was known from fc-player to 3-player games |Bub79| . Such a reduction cannot exist 
^ . to 2-player games due to issues of irrationality [Nas51 , hence the need to consider the notion of e- well- 
supported Nash in this context. Our reduction guarantees that for appropriate choices of 62 and et, 
given any e2-well-supported Nash for the 2-player game, normalizing its probabilities according to the 
above correspondence immediately gives an e^-well-supported Nash for the fc-player game. 

The direct reduction makes no use of the concept of PPAD. This eliminates some of the difficulties 
involved in following the known indirect reduction. It is inevitable that unlike the indirect reduction, 
our reduction by itself does not establish the PPAD-completeness of computing (or approximating) Nash 
equilibria. Nevertheless, the new gadgets we introduce are relevant to the notion of PPAD-completeness, 
as they can be used in other reductions among PPAD problems. Moreover, our reduction provides an 
alternative proof to the proof of Daskalakis et al. [DGP09J that rinding an approximate Nash equilibrium 
in fc-player games is in PPAD. 
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In the fc-player case, the payoff of each player depends on the combined behavior of the other players. 
We can thus view each player's set of expected payoffs as a set of multiplicative functions in the other 
players' strategies. In a 2-player game, however, each player interacts with a single other player, and 
so the expected payoffs are linear [vS07| . The described gap calls for "linearization" of /c-player games, 
and indeed the first step of our reduction replaces the multilateral interactions among the k players 
with bilateral interactions among pairs of players. In the next step, two representative "super-players" 
replace the multiple players, resulting in a 2-player game. 

In terms of techniques, the first step of the reduction uses and extends the machinery of gadget games 
developed by Goldberg and Papadimitriou |GP06j . We introduce a new gadget for performing approxi- 
mate multiplication using linear operations, in order to bridge the gap between multiplicative and linear 
games. The second step of the reduction uses similar methods to [GP06J and [MT09] in order to replace 
multiple players by 2 players. The resulting 2-player game is a combination of a generalized Matching 
Pennies game |GP06] and an imitation game [MT09J . 

1.1 Preliminaries 

Let [n] = {1, . . . , n}, and \\v\\ = ]T^ \vi\. For vectors u and v of length n, let u <g> v denote their tensor 
product written as a vector of length n 2 , where entry (i — l)n + j is UiVj. We write x = y ± z to denote 
y — z < x < y -\- z. For vectors, x = y ± z denotes j/j — z < Xi < y% + z for every i. 

Normal Form Games Players of a normal form game Gk are numbered from 1 to k. Unless stated 
otherwise, every player has n pure strategies numbered from 1 ton. A pure strategy profile s is a vector 
of length k in [n] x • • • x [n], containing one pure strategy per player. s~ * is a pure strategy profile for 
all players except i, obtained from s by removing the i'th entry. A payoff matrix M l = M G for player 
i is of size n x n . Unless stated otherwise, all entries are rationals in the [0,1] range. M l [j,s~ l ] 
is the payoff player i receives for playing pure strategy j against pure strategy profile s~ \ A mixed 
strategy p 1 for player i is a probability distribution over [n], denoting the probabilities with which i 
plays her pure strategies. Its support is the set of pure strategies {j : //• > 0}. A mixed strategy profile 
p = (p 1 , . . . ,p k ) is a set of mixed strategies for every player, and p~ l is a similar set for every player 
except i. Let p be the joint mixed strategy distribution, i.e. p = p 1 <g> • • • <g> p . For every pure strategy 
profile s, entry p[s] is the probability n«Ps ^ na ^ everv player i plays pure strategy Sj. Let p~~ l be the 
joint mixed strategy of all players except i. Given a mixed strategy profile p~ z , the expected payoff 
vector Mg equals M % p~ l . The j'th entry u % G [j] is the expected payoff player i receives for playing 
pure strategy j while the others play p~~ \ Thus, the expected payoffs are algebraic functions in the 
probabilities played by the others. 

Polymatrix (Linear) Games In a polymatrix game, every player plays bilaterally against other 
players, and receives the sum of payoffs obtained from these bilateral interactions. Thus, polymatrix 
games are actually collections of 2-player games in which every player plays the same strategy in every 
game she participates in. Players are numbered from 1 to m; player i has 2 < rii < n pure strategies and 
771 — 1 rational payoff matrices M %,% of size rii x ny. Entry M 1 ' 1 [j,j'] is the payoff to player i for playing 
j against player i! who plays j'. If players i,i' do not interact or if their interaction is one-sided and 
does not influence player i's payoff, then M J,J is set to be all-zeros. Given a pure strategy profile s~ l , 
the total payoff to player i for playing j is Yli'^i -^ v ' \ji s ~ l [i']\- Given a mixed strategy profile p~ x , 
the expected payoff vector of player i is u G = J2i>^i M % ' 1 p 1 ■ Equivalently, if M G = (M 4>1 • • • M l ' m ) 
contains all the player's payoff matrices as submatrices, then u G = M G p~ l . The expected payoffs 
of a player are thus linear functions in the probabilities of the others. Unlike normal form games, 
the size of polymatrix games is polynomial in n even when the number of players m is non-constant 
(m = poly(n)). 



Nash Equilibrium, Approximations and Computational Problems A Nash equilibrium is a 
mixed strategy profile such that the players of the game cannot improve their expected payoffs by 
deviating from it unilaterally. The supports of a Nash equilibrium contain only pure strategies that 
are best responses, i.e. maximize the expected payoff given the mixed strategies of the other players. 
Formally, given a mixed strategy profile p~~ *, pure strategy j is a best response for player i if Ug[j] = 
max fe[n] {u l G [j'}}. 

Every game has a Nash equilibrium |Nas51j . but finding such an equilibrium may be difficult. There 
are games for which every Nash equilibrium contains irrational probabilities, making it hard even to 
represent. This motivates the consideration of approximate instead of exact Nash equilibrium. In 
the context of reductions from fc-player to 2-player games, there is another motivation for considering 
approximate Nash equilibrium. Unlike k player games, 2-player games always have a rational Nash 
equilibrium [Nas5H Pap07| . Thus we do not expect to find a reduction that preserves exact Nash 



equilibrium, direct or indirect. 

There are several possible notions of approximation. We focus on the notion of e- well- supported Nash 
equilibrium, a mixed strategy profile whose supports contain only e-best responses, i.e. pure strategies 
that maximize the expected payoff up to an additive factor of e. We will primarily be interested in 
small, non-constant values of e, namely e = l/poly(n) and e = l/exp(n). A related, computationally 
equivalent approximation notion is that of e-Nash equilibrium - a mixed strategy profile from which 
deviating unilaterally cannot improve a player's expected payoff by more than e [DGP09J . For other 
approximation notions see |EY07j . 

Definition 1.1 (ej-fcNASH and e m -LINEAR-NASH) Given a pair of normal form game Gk and 
accuracy parameter e^, the problem ek-kNASH is to find an e^-well- supported Nash equilibrium of G^. 
Given a pair of polymatrix game G m and accuracy parameter e m , the problem e m -LINEAR-NASH is to 
find an e m -well- supported Nash equilibrium of G m . 

1.2 Our Results 

Let (G mi , e mi ), (G m2 ,e m2 ) be two pairs of games and accuracy parameters. The games have mi,m2 
players respectively; the number of pure strategies of player i is nj,nf respectively. The following 
definitions are based on the notion of reduction scheme defined by Bubelis |Bub79j . 

Definition 1.2 (Mapping between Games) A mapping from G mi to G m2 includes: 

• A function g : [mi] — > [m-2] mapping players of G mi to players of G m2 ; 

• For every i G [mi], an injective function hi : [n\] — > [wj?/^] mapping pure strategies of player i to 
distinct pure strategies of player g(i). 

Definition 1.3 (Direct Reduction) A direct reduction from (G mi ,e mi ) to (G m2 ,e m2 ) is a mapping 
from G mi to G m2 , such that for every e m2 -well- supported Nash equlibrium (q 1 , . . . , q m2 ) of G m2 , an 
e mi -well- supported Nash equilibrium (p , . . . ,p mi ) of G mi can be obtained by renormalizing probabilities 
as follows: p t [j] = (l/z)q 9 ^'[hi(j)] (where z is a normalization factor). 

Theorem 1.4 (Main) For every e/t < 1, there exists a direct reduction from ek-kNASH to E2-2NASH, 
where €2 = poly{ek/\Gk\). The reduction runs in polynomial time in \G}.\ and in log(l/efc). 

Corollary 1.5 There is a direct, polynomial time reduction from (1/ exp(n))-kNASH to (l/exp(n))- 
2NASH, and from (l/poly(n))-kNASH to (l/poly(n))-2NASH. 

Proof of ITheorem 1.4l By combining ITheorem 3.11 (linearizing reduction) with ITheorem 4!T1 (reduc- 
tion from linear to bimatrix games), and plugging in the parameters of ILemma 2.31 (logarithmic-sized 
linear multiplication gadget). ■ 



For simplicitly of presentation we defer the proof of lLemma 2.3l to lSection~5l and first prove in lSection 21 
a slightly weaker version ([Lemma 2.21 - polynomial-sized linear multiplication gadget), resulting in a 
reduction that runs in polynomial time in l/e^ instead of log(l/efc). 

1.3 Related Work 

Bubelis [Bub79j shows a direct reduction from A;-player to 3-player games. This reduction relies heavily 
on the multiplicative nature of 3-player games. Examples of direct reductions involving 2-player games 
include symmetrization [GKT50J . and reduction to imitation games [MT09J . We use imitation games 
in Section [H 

PPAD-completeness results Papadimitriou introduced PPAD in 1991, motivated largely by the 
challenge of classifying the Nash equilibrium problem |Pap94| . Formally, PPAD is the class of to- 
tal search problems polynomial-time reducible to the abstract path-following problem END OF THE 
LINE. Another important PPAD-complete problem is 3D-BROUWER, a discrete version of finding 
Brouwer fixed-points in a 3-dimensional domain (the same problem in high-dimension is known as riD- 
BROUWER). The known results can be summarized by the two following chains of reductions, each 
forming an indirect reduction (according to lDefinition 1.3l of directness) from fc-player games to 2-player 
games: 

• l/exp(n)-/cNASH < END OF THE LINE < 3D-BROUWER < ADDITIVE GRAPHICAL NASH 
< l/exp(n)-2NASH 

• l/exp(n)-/eNASH < END OF THE LINE < 2D-BROUWER < raD-BROUWER < l/poly(n)- 
2NASH 

The reductions in the first chain are by [vdLT821 IDGP09J . |Pap94[ IDGP09J . [CD06bl IDGP09J and 



[DGP09J . respectively. The reductions in the second chain are by [vdLT821lDGP09] . [CD06aj . [CDT06J . 
[CDT06J . respectively. For an overview of these celebrated results see [RoulOj . In comparison, our 
reduction can be written as: 

• e fc -/fcNASH < e m -LINEAR-NASH < e 2 -2NASH 

where e&, e m , e 2 can either be all l/exp(n) or all l/poly(n). Note there is gap between the second chain 
of reductions and our results - the second chain achieves a stronger reduction from l/exp(n)-/cNASH to 
l/poly(n)-2NASH. Achieving a direct version of this result by [CDT06J is an interesting open problem. 
Note also that our reduction from e m -LINEAR-NASH to 62-2NASH is somewhat similar to the reduction 
from ADDITIVE GRAPHICAL NASH to l/exp(ra)-2NASH, however our reduction does not require 
the input game to be bipartite nor does it limit the number of interactions per player. 

Another open question is the complexity of efc-fcNASH and 62-2NASH for constant values of €k,€2- As 
a quasi-polynomial algorithm is known [Alt94[ ILMM03] . these problems are not believed to be PPAD- 
complete. The current state-of-the-art is a polynomial-time algorithm for 62-2NASH where e 2 ~ 0.667 
[KS10] . For finding 62-Nash equilibrium rather than 62-well-supported Nash equilibrium, there is an 
algorithm where e 2 » 0.339 fTE07\ (see also [DMP06J . [BBM07J . |T509| ). On the negative side, several 
algorithmic techniques have been ruled out [HK09J . [DP09] . 

Reductions to 2-player games and linearization The empirical success of the Lemke-Howson 
algorithm [LJI64] for finding Nash equilibrium in 2-player games has motivated research on extending 
it to a more general class of games. Daskalakis et al. show a general reduction from succinct games 
to 2-player games, which can be applied to any game in which the expected payoffs can be calculated 
using only +, *, max [DFP06]. Their reduction goes through the steps of the first chain of reductions 
above. Govindan and Wilson present a non-polynomial linearizing reduction, which reduces multiplayer 
games to polymatrix games while preserving approximate Nash equilibrium [GWlOj . Their reduction 
introduces a central coordinator player, who interacts bilaterally with every player while simulating the 



combined behavior of the other players. 

In addition, linearization is also related to Etessami and Yannakakis's formulation of PPAD as the class 
of fixed-point problems for piecewise-linear functions (computable by +, scale, max) [EY07J . 

2 A Linear Multiplication Gadget 

In this section we construct a linear multiplication gadget using standard gadgets as building blocks. 

Theorem 2.1 (Linear Multiplication Gadget) There exist constants eq < 1, c, d and an increasing 
polynomial function f such that the following holds. For every e < eo, there exists a linear multiplication 
gadget G* = G*(e) of size 0(m • /(-)), such that in an e-well- supported Nash equilibrium, the output of 
G* equals the product of its m inputs up to an additive error of±dme c . 

We develop two different constructions of G*, with two different sets of parameters €o,c,d,f. 

Lemma 2.2 (Polynomial-Sized Construction) \Theorem 2.1\ holds with the following parameters: 1 
eo = j, c = 1, d = 19 and f(x) = x 2 . 

Lemma 2.3 (Logarithmic-Sized Construction) \Theorem 2.1\ holds with the following parameters: 
e o = W> c = \, d = 3 and f(x) = logs. 

The second construction gives a smaller gadget with size 0(m log-) instead of 0(™), but is more 
complicated than the first construction. The rest of this section describes the first construction and 
proves [Lemma 2T2l Details of the second construction and the proof of lLemma 2.31 appear in lSection 51 

2.1 Linear Gadgets 

Goldberg and Papadimitriou developed the framework of gadgets |GP06j . carefully-engineered games 
that simulate arithmetic calculations and are useful in many PPAD-completeness results (see, e.g., 
[DGP09J ). The players of a gadget game are typically binary, representing numerical values in the 
range [0, 1]. 

Definition 2.4 (Binary Player) A binary player P is a player that has exactly two pure strategies 
and 1. We say P represents the numerical value p € [0, 1] if her mixed strategy is (1 — p,p), i.e. she 
plays pure strategy 1 with probability p. 

Gadget games have three kinds of binary players - one or more input players, 2 one output player, and 
one or more auxiliary players. The size of a gadget is the number of its auxiliary and output players. 
The values represented by the input and output players are the input values and output value of the 
gadget. In every e-well-supported Nash equilibrium of the gadget game, the output value p is equal to 
the result of an arithmetic operation on the input values (up to small error). This arithmetic relation 
between the input and output values is the guarantee of the gadget. To achieve the guarantee, the 
output player is incentivized to play the appropriate value p, by choosing appropriate payoff values for 
both the output and auxiliary players. Our reductions require gadgets with linear guarantees, which 
differ slightly from the graphical and additive-graphical gadgets used in previous works. 

Definition 2.5 (Linear Gadgets) A linear gadget is a polymatrix gadget game with payoffs in [0, 1]. 
Linear gadgets simulate linear arithmetic operations, i.e. their guarantee is a linear relation between 
the input and output values. 



x The choice of d — 19 simplifies the proof, but it is not hard to show that for the same construction d can be replaced 
with a smaller value. 

2 Gadgets can also have non-binary input players, in which case the value the input players represent is considered to 
be the probability with which they play a certain predetermined pure strategy. 



Several gadgets can be combined into a single game, much like arithmetic gates are combined into 
a circuit to carry out involved calculations. By setting the output player P of gadget G\ to be an 
input player of gadget G2, the value p represented by P is shared among the gadgets. We represent a 
combination of gadgets by a series of calculations on the input and output values. For example, if P' is 
the output player of G2 representing the value p', then we write the above combination as p' = G^p) 
(where in turn p = Gi(. . .)). The following fact explains why the same player can be an input player 
of multiple gadgets, but can only be the output player of a single gadget (as for auxliary players, they 
are considered part of the inner implementation and are thus never shared among different gadgets). It 
is a consequence of the gadget determining the payoff matrix of its output player, but not of its input 
players. 

Fact 2.6 (Combining Gadgets) For every game in which no player is the output player of more than 
one gadget, the guarantees of all gadgets hold simultanuously when the game is in e- well- supported Nash 
equilibrium. 

2.1.1 Standard Gadgets 

The following gadgets are constructed by Daskalakis et al. [DGP09]. To demonstrate the principle 
behind their construction, we include here the proof of iLcmma 2,7( proofs of lLemma 2.8l and lLemma 2.91 



appear in Appendix A for completeness. 



Lemma 2.7 (Linear Threshold Gadget) For every rational C, 6 [0,1], there exists a linear gadget 
G>£ of size O(l) with input p\, such that in an e- well- supported Nash equilibrium the output is 1 if 
pi > C + e and if p\ < ( — e, and otherwise it may be any value in [0, 1]. 

Proof: Let P±,P be the input and output players of G>£ representing values pi,p, respectively. We 
set the payoff matrix M ' J to be: 

M- = ( < < ) 

G>£ has no auxiliary players, and so this concludes the construction. We now show that when G>£ is in 
e-well-supported Nash equilibrium, the guarantee of this gadget holds. Let p 1 = (1 — pi,pi) be player 
Pi's mixed strategy in the e-well-supported Nash equilibrium. The expected payoff vector u of player 
P is equal to: 

u p = M p ^p 1 = (C, Pl ) 

If p\ > C + e, the only e-best response for player P is pure strategy 1, so P's mixed strategy (1 — p,p) 
in the e-well-supported Nash equilibrium must be (0, 1) and thus p = 1. Similarly, if p\ < £ — e then 
(1 —p,p) = (1,0) and thus p = 0. ■ 

Lemma 2.8 (Linear AND Gadget) There exists a linear gadget G^ of size O(l) with inputs pi,P2, 
such that in an e-well-supported Nash equilibrium where e < j the output is 1 if p\ = pi = 1 and if 
(pi = 0) V (p2 = 0), and otherwise it may be any value in [0, 1]. 

Lemma 2.9 (Linear Scaled-Summation Gadget) For every rational C £ [0, 1], there exists a linear 
gadget G + ^^ of size 0(1) with inputs p\, . . . ,p m , such that in an e-well-supported Nash equilibrium the 
output is mm{((pi + • • • + p m ), 1} ± e. 

In addition, there exist standard gadgets for multiplication, but these are inherently nonlinear - the 
constructions are based on expected payoffs being multiplicative functions in players' probabilities (see, 
e.g., |DGP09| ). 



2.2 Construction 

Here we show the construction of G* that will be used to prove ILemma 2.21 We show a construction 
for multiplying 2 inputs, and multiplying m inputs can be achieved by connecting m — 1 copies of this 
construction serially. Let P\, P2 be the input players representing values p±,P2, and let P be the output 
player representing value p. Let r = 3e (for simplicity assume that 1/r is integer). We first encode 
every input in unary representation, with precision of up to ±r. For this we use 2/r auxiliary players: 
The vectors v 1 = (v\, . . . , v^ , ) and v 2 = (vf, . . . , v 2 ,) of values represented by auxiliary players {V^} 

and {V 2 } are the unary encodings. The i'th unary bit of p\ is vj, and it is calculated by the threshold 
gadget G>£ (jLemma 2.7[) as follows: vj = G>j T (pi). Similarly, vf = G > i T (p2)- Then we perform 
unary multiplication using the AND gadget G/\ (jLemma 2.8|) . The result is a matrix U, which contains 
1/r 2 values Uij = G^(vj,v 2 ), represented by auxiliary players {Uij}. The construction is complete by 
summing up and scaling U's entries using the scaled-summation gadget G +] *£ (jLemma 2.9|) as follows: 
p = G + * T 2(ui t i,ui t 2, ■ ■ ■ ,ui/ t ,i/t)- This establishes the relation between the input values pi,p2 and the 
output value p of G*. Note that the payoffs of all players are determined by the standard gadgets. 

2.3 Correctness 

We prove [Lemma 2 .21 for the case m = 2. Namely, we show that for every e < 1/4, when G* is in e-well- 
supported Nash equilibrium then p = p\P2 ± de, that G* is linear and that the size of G* is 0(l/e 2 ). 
The proof of ILemma 2.21 for general m follows, since concatenating m — 1 copies of G* increases the 
error and gadget size by a multiplicative factor of m. 

Proof of ILemma 2.21 (Polynomial-Sized Construction): First note that G* is a combination of 
linear gadgets and is thus itself linear. The size of G* is 0(l/r 2 ), the total size of the standard gadgets 
(2/t threshold gadgets G>^, 1/t 2 AND gadgets G A , and 1 scaled-summation gadget G+*£, all of size 
0(1)). 

We assume G* is in e- well-supported Nash equilibrium where e < 1/4, and write the input values pi,P2 
as integer multiples of r plus a small error: let p\ = i*T + 5\ and P2 = j*T + 82, where < i*,j* < 1/t 
and < <5i,<52 < t. The following claim shows that the coefficients i*,j* are correctly encoded as 
unary vectors v , v 2 , and is a direct consequence of the threshold gadget's guarantee (jLemma 2.7j) . The 
threshold gadget is "brittle" in the sense that for a small range of inputs it returns an arbitrary output, 
but the choice of r = 3e ensures this happens for at most one unary bit. 

Claim 2.10 (Unary Encoding) v 1 is of the form (1, . . . , 1, ?,0, . . . ,0), where 1 1 1? 1 1 1 = i* ± 1 and 1 ' 
denotes any value in [0, 1]. The same holds for v 2 and j* . 

Proof: Consider the i'th entry of v 1 . By construction, vf = G > i T {p\). By ILemma 2.71 vj indicates 
whether p\ > ir + e or p\ < ir — e, and otherwise can be any value in [0, 1]. Since r = 3e we know that 
pi > (i* — 1)t + e, therefore for every i < i* — 1 entry vj is equal to 1, and in total \\v \\ > i* — 1. On 
the other hand we know that p\ < (i* + 2) — e, therefore for every i > i* + 2 entry vj is equal to 0, and 
in total {{v 1 \\ < i* + 1. Moreover, since r > 2e, there can be at most one value of i for which p\ = ir± e, 
and so there can be at most one entry i of v 1 which is an arbitrary value '?' in [0, 1]. ■ 

The rest of the proof of ILemma 2.21 is a straightforward corollary of the other gadget guarantees. Let 
\\U\\ denote the sum ^V ■ mj of matrix U's entries. By construction, p = G + ^ T i{ui t \,U\ i 2i ■ ■ ■ , u i/ t ,\/t)-> 
thus by the guarantee of gadget G +j ^ (jLemma 2.9|) . p = t 2 \\U\\ ± e. We write the product P1P2 as an 
integer multiple of r 2 up to a small error: i*j*r 2 < p\P2 < i*j*r 2 + 3r. The next claim shows that \\U\\ 
gives approximately the correct coefficient of r 2 . 

Claim 2.11 (i* - l)(j* - 1) < \\U\\ < (i* + l)(j* + 1) 



Proof: Consider the (i,j)'th entry of U. By construction, mj = G A (vj,vJ). Bv lLemma 2.81 if e < 1/4 
and vj = Vj = 1 then ttjj = 1. By IClaim 2.10| there are at least (i* — l)(j* — 1) pairs i,j such that 
vj = v? = 1, and so ||C/|| > (i* - l)(j* - 1). Similarly, bv lLemma 2.81 if e < 1/4 and vj = V «| = 
then ujj = 0. By IClaim 2.101 there are at most (£* + l)(j* + 1) pairs i, j such that vj j^ Av'j ^ 0, and 
so ||t/|| < (i* + l)(j* + l). ■ 

Since ?*,j* < 1/r, it follows from the above claim that \\U\\ = i*j*±(2/r + l). Sop = r 2 i*j*±(3r + e) = 
P1P2 ± (6r + e) = P1P2 i de, where d = 19. This concludes the proof of ILemma 2.21 showing that G* 
outputs the product of its inputs P1P2 up to a small error of ±de. ■ 

Example 2.12 Let p\ = It + e/4 and P2 = 2r + (r — e/8). Firs£ we /znd the unary encoding: v 1 = 
(1, 1, 1, 1, 1, 1, ?, 0, . . . , 0) and v 2 = (1, 1, ?, 0, . . . ,0). XTien we perform unary multiplication: 

( 1 1 1 1 1 1 ? \ 
1111117 
???????0 



f/' 




\00000000y 



\ u u / 

1/r X 1/r 



Summing up and scaling the entries of U we get p = 12r 2 + 0(e), which is close to p\P2 up to O(e). 

3 Linearizing Multiplayer Games 

In this section we show a direct reduction from /c-player games to polymatrix games. Let Gk denote the 
input game to the reduction, and let G m denote the corresponding output game. The reduction relies on 
the fact that, although GVs expected payoffs are nonlinear in its players' probabilities, they are linear 
in products of its players' probabilities. A key component of our reduction is a linear multiplication 
gadget for computing these products, which exists according to ITheorem 2.11 Let / be an increasing 
polynomial function as in ITheorem 2.11 

Theorem 3.1 (A Linearizing Reduction) For every e^ < 1, there exists a direct reduction from 
€k-kNASH to e m -LINEAR-NASH, where e m = poly(ef~/\Gf~\)- The reduction runs in polynomial time in 
\G k \ and in f(l/e k ). 

Lemma 3.2 (Recovering e^-Well-Supported Nash) Let (p , . . . ,p m ) be an e m -well- supported Nash 
equilibrium of G m . Then the first k mixed strategies p , . . . ,p form an e^-well- supported Nash equilib- 
rium of Gk ■ 

3.1 Preserving Expected Payoffs 

The following lemma will be useful in desiging the linearizing reduction. Let Gk be a game with k 
players, n pure strategies each. Let G m be a game with m > k players, where the first k players have 
the same pure strategies as the players of Gk- Let (p 1 , . . . ,p fe ), (p 1 , . . . ,p m ) be mixed strategy profiles 
of Gfc, G m . 

Lemma 3.3 (Almost Equal Expected Payoffs) If for every player 1 < i < k, the expected payoff 
vectors Uq and Uq are entry-wise equal up to an additive factor of 5, and (p 1 , . . . ,p m ) is an em- 
well-supported Nash equilibrium of G m , then (p 1 , . . . ,p ) is an ek- well- supported Nash equilibrium of 
G k where e k = 25 + e m . 

Proof: Let j € [n] be a pure strategy in the support of player i (jA > 0). We know that j is an e m -best 
response in G m . Assume for contradiction that j is not an e^-best response in Gk, i-e. there is a pure 
strategy f £ [n],f / j such that v^JJ') > u^ k (j) + e fc . So u\, m (j') + 5 > vfcjj) - 6 + e k . Since 
ek — 25 = e m , then u l G (j') > u l G (j) + e m , contradiction. ■ 
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Original player 2 



p 1 [1]p 1 [2] p 1 [n] f?mf?\2\ - f[n] 
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(n.n) 



Payoff matrix M 3 



Figure 1: Linearization of a 3-Player Game - Partial View of G m 

The arrows indicate how the probabilities of original players 1 and 2 influence the expected payoff of 

original player 3 via a layer of gadgets and mediator players. 



3.2 The Linearizing Reduction 

Given an input pair (Gk, £&)> we find an output pair (G m , e m ) as follows. Let eo < 1, c, d be the constant 
parameters of lTheorem 2.11 Then e m = min{(efc/3n dk) 1 ' , eo}. The players of G m are: 

• Original players - the first k players of G m have the same pure strategies as G^'s players, p 1 
denotes the mixed strategy of original player i. 

• Mediator players - for every i £ [k], there is a set of n k ~ 1 binary players that corresponds to the 
set of n pure strategy profiles of all original players except i. We denote by Q s -i the mediator 
player corresponding to pure strategy profile s~' 1 and by q s -i the represented value. 

• Gadget players - all auxiliary players belonging to kn copies of the linear multiplication gadget 

Cx*. 



[k]> 



Every mediator player is set to be the output player of a gadget G* as follows: q s -i = G* (p\-i , x ,, ■ ■ ■ ,p k s 
Thus, q s -i will be approximately equal to the probability with which the original players play the pure 
strategy profile s~ % . Let q z be the vector of values {q s -i}, then it's approximately equal to p~ z , the 
joint mixed strategy distribution of all original players except i. 

To complete the description of G m it remains to specify the non-zero payoff matrices of the original 
players (all other payoffs are determined by the gadgets). In Gk, the expected payoff vector of player 
i is u G = Mq p~ x . In G m , the payoff of original player i will be influenced only by the i'th set of 



mediator players {Q s -i} who play q 1 . Instead of describing every payoff matrix M 



i,Q„ 



separately, 



(such a description appears in the proof of lLemma 3.2|) . we describe one large payoff matrix Mq that 
contains all the others (or more precisely, all their nonzero columns) as submatrices. We want the 



expected payoffs in G m to be as close as possible to those of Gk- 
concludes the contraction. 

3.3 Correctness 



Thus, we set M. 



( T D 



M, 



Gk' 



This 



Proof of ITheorem 3.T1 (A Linearizing Reduction): The reduction runs in time polynomial in 
\Gk\ = @(kn k ) and in /(l/e^): The running time depends on the size of the polymatrix game G m , 
which is polynomial in the number of its players. There are k original players, kn mediator players 
and kn k ~ 1 0(\G*\) auxiliary players. By ITheorem 2.1| |G>| = 0(k • /(l/e m )). Since / is a polynomial 
function and e m = poly(ek/\Gk\), the total number of players is indeed polynomial in \Gk\ and in 



mi 



/(1/efe). The rest of the proof follows from ILemma 3 .21 

Proof of ILemma 3.21 ( Recovering e^- Well-supported Nash after Linearization): Let (p 1 , . . . , p 
be an e m -well-supported Nash equilibrium of G m . We show that the first k mixed strategies of 
(p 1 , . . . ,p m ) form an e^-well-supported Nash equilibrium of Gk- We would like to upper bound the 
entry- wise distance between the payoff vectors u G , u G so that we can apply ILemma 3.31 The proof 
proceeds as follows: We show that the expected payoff vector of original player i in G m is u G = M G q l . 
Then we observe that the linear multiplication gadget G> guarantees that vectors q % and p~ % are close 
to each other, and recall that M G = M G . Since all payoffs are in [0, 1], we conclude that the expected 
payoffs u G = M G p~ * are preserved in G m . The proof of ILemma 3.2l is then immediate by preservation 
of expected payoffs (jLemma 3.3|) . 

We start by an alternative, more formal description of the original players' payoff matrices in G m . 
Consider the payoff matrix M 8 '^ - ', corresponding to the interaction between original player i and 
mediator Q s -%. Since Q s -% is a binary player with pure strategies {0, 1}, the size of M 1 '^"' is n x 2. 
For every j £ [n] we set M 4 '^« _i [j, 1] = M G [j, s~ *] (where M G is the payoff matrix of player i in 
game Gk), and M 1 '®*-* [j, 0] = 0. So the column M , ' £ *«~'[',0] corresponding to the mediator's pure 
strategy is all-zeros. The payoff matrix M G was defined above to contain all nonzero columns of 
payoff matrices M 1 '^-*, i.e., all columns M*'^« - *[-, 1]. It is now not hard to verify that M G = M G , 
and so the alternative description is equivalent to the original one. 

Claim 3.4 (Expected Payoffs Vector) For every i € [A;], the expected payoff vector of original player 
i in game G m is u G = M G q l . 

Proof: u G is equal to the sum of expected payoff vectors of original player i from playing bilaterally 
against every mediator player in {Q s -i}- Each expected payoff vector is a product of the payoff matrix 
jy[i,Q s -i w jth vector p*^s -i = (1 — q g -i, q s -%) (the mixed strategy played by the binary mediator player 
Q g -i). By construction of M % '^a-* , the expected payoff vector is equal to the product of column vector 
M l '^s- i [., 1] with scalar q B -%. Therefore, the sum of expected payoff vectors over all mediators is equal 
to M Gm q\ U 

We now show that q 1 and ff~ % are almost equal. Consider entry q a -% of q % . By construction, q s -i = 
G*(j>^_. jrj,, . . . ,Pg— jr fe i). By ITheorem 2.11 and since e m < eo, the gadget G* guarantees that q a -% = 

W.i'j=iP % B - tun ^ dk(e m ) c . By definition of p~ l as the joint mixed strategy distribution of all players 

except i we get that q s -i = p~ l [s~' 1 ] ± dk(e m ) c . Thus, q 1 = p~ % ± dk(e m ) c . 

Using the fact that the entries of M G ,M G are all in the range [0,1], and that the dimensions of 
the matrices are n x n k ~ 1 , we conclude that M G q z = M G p~ % ± n k ~ l dk{e m ) c . We can now apply 
ILemma 3.31 with 5 = n k ~ l dk(e m ) c . So (p 1 , . . . ,p k ) is a (25 + e m )-well-supported Nash equilibrium of 
Gk, and plugging in the chosen value of e m gives e^-well-supported Nash equilibrium, as required. ■ 

4 Reducing Linear Games to Bimatrix Games 

In this section we show how to replace the multiple players of a polymatrix game by two representative 
"super-players" of a bimatrix game. Let G m denote the input game to the reduction, and let Gi denote 
the corresponding output game. 

Theorem 4.1 (Linear to Bimatrix) For every e m < 1, there exists a direct reduction from e m - 
LINEAR-NASH to C2-2NASH, where e% = poly(e m /\G m \). The reduction runs in polynomial time 
in \G m \ and in log(l/e TO ). 
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Lemma 4.2 (Recovering e m - Well-Supported Nash) For every €2- well- supported Nash equilibrium 
(x, y) of G2, partitioning y into subvectors y 1 , . . . , y m of lengths m, . . . , n m and normalizing gives an 
e m -well- supported Nash equilibrium (y^/Wy^W, • • • , 2/ m /||2/ m ||) of G m . 

4.1 Imitation Games and Block e-Uniform Games 

The following definitions and lemmas will be useful in proving ITheorem 4.11 An imitation game is a 
bimatrix game in which both players have iV pure strategies, and the payoff matrix of player 2 is equal 
to the N x N identity matrix In- We call player 1 the leader and player 2 the imitator. A similar 
lemma to the following was proved in |MT09| for the case of exact Nash equilibrium. 

Lemma 4.3 (Imitation) Let (x,y) be an e-^-well- supported Nash equilibrium of an imitation game G2 
where €2 < 1/N. Then support(y) C support(x). 

Proof: Assume pure strategy j is not in support(a;), i.e. Xj = 0. The expected payoff vector of the 
imitator is u^, = Ij^x = x, and so for pure strategy j the expected payoff is Xj = 0. Since a; is a 
probability distribution vector with N entries of which one is assumed to be zero, there exists a pure 
strategy j' ^ j for which the imitator's expected payoff is Uq [j 1 ] = xy > 1/{N — 1) > e. The difference 
between the expected payoffs is more than e, so j cannot be an e-best response for the imitator and so 
does not belong to support(y). We conclude that support(y) C support (a;), as required. ■ 

We call a bimatrix game block e-uniform if player l's payoff matrix A is of the following form: 

• Block matrix: A is composed of m? blocks, where block (i,i'), denoted A i,i , is of size n% x ny, 

• Very negative diagonal: The i'th diagonal block A 1 ' 1 is equal to —aE ni , where a = 8m 2 /e and E ni 
is the all-ones matrix of size rii x m; 

• [0, 1] entries: All other entries of A are arbitrary values in the range [0, 1]. 

For a similar construction see the generalized Matching Pennies game of |GP06j . If x,y is a mixed 
strategy profile of an e-block-uniform game, we denote by x , ... , a; m and y , . . . , y m the mixed strategy 
blocks of size n±, . . . ,n m . We say that block i belongs to the support of mixed strategy x if there is 
some pure strategy in block i that belongs to this support. The following lemma shows that in a block 
e-uniform game, the weight of player 2 is e-uniformly divided among all blocks i in support (a:). 

Lemma 4.4 (e-Uniform Weight Distribution) Let x,y be an £2- well- supported Nash equilibrium 
of a block €2-uniform game G?2- If block i G [m] belongs to the support of x, then for every %' £ [m], 
||y*|| < ||y*'|| + (l + €2)/a. 

Proof: The expected payoff vector Uq of player 1 is Ay. By construction of matrix A, the expected 
payoff vector for playing pure strategies in block i is X^'eM A 1 ' 1 y l . The domininant vector in this 
sum is A % ' % y % , whose entries are all — a||j/ l ||. The entries of every other vector A 1 ' 1 y 1 in the sum are 
in the range [0, \\y l ||], and since y is a distribution vector, the total contribution to the sum is at most 
Si'Gfml \\y l II = 1- Thus, the expected payoff for playing any pure strategy in block i is in the range 
[— a||y J ||, — q:||j/*|| + 1]. Assume for contradiction that ||y J || > \\y % || + (1 + €2) /a.- Then the expected 
payoff for playing a pure strategy in block i is at most — a(||y* || + (1 + 62) /a) + 1, while the expected 
payoff for playing in block i! is at least — a(||j/* ||). The difference is more than €2, contradicting the 
assumption that i belongs to support(a^). ■ 

If a game is both imitation and block e-uniform, then the weight of player 2 is divided e-uniformly 
among all blocks in [m]. 

Corollary 4.5 (Imitation and Block e-Uniform) Letx,y be an €2-well- supported Nash equilibrium 
of a block €2-uniform imitation game G2, where €2 < 1/N. Then for every two blocks i,i' G [m], 
||y i || = ||y i '||±(l + e2)/a. 

II 



Proof: Since y is a distribution vector, there exists a block i £ [m] such that \\y*\\ > 1/m. So i 
belongs to the support of y, and by ILemma 4.31 i also belongs to the support of x. By ILemma 4.41 
1/m < \\y % \\ < ||y* || + (1 + 62) /a for every i' £ [m]. Since (l + e2)/a < 1/m we conclude that < ||y* || 
for every i! . Thus by ILemma 4.31 all blocks are in support(a;) and get almost uniform weight. ■ 

4.2 The Reduction 

Given an input pair (G m , e m ), we show how to find an output pair (G2, £2)1 where G2 has payoffs in the 
range [— a, 1]. To complete the reduction, G2 can then be normalized by adding a to all payoffs and 
scaling by l/(ct + 1) fa is also scaled). Let N = YaLi n « be the total number of pure strategies in G m . 
Let €2 = e m /N. The pure strategies of every player in G2 are the set [N]. The payoffs are chosen such 
that G2 is both an imitation game and a block e2-uniform game: 



/ 



A 






1.2 



M 

-aE r , 



M i,m 

M 2,m 



\ 



( In, 





,B 







\ 




V M^ M^ ■■■ -aE nm j NxN \ ••• I nm / NxN 

where M 1 ' 1 is the payoff matrix of player i for interacting with player i' in G m . 
4.3 Correctness 



Proof of lTheorem 4. II (Linear to Bimatrix): First note that the reduction runs in time polynomial 
in \G m \ = 0(-/V 2 ) and in log(l/e m ): The running time depends on the size of the bimatrix game G2, 
whose payoff matrices are of size iV 2 with entries of size O(loga). It's enough to prove [Lemma 4 .21 for 
the unnormalized game G2 and €2 = e m /N; this immediately gives a proof for €2 = e m /N(a + 1) after 
normalizing the payoffs from [—a, 1] to [0, 1]. Since e m /N(a + 1) = poly(e m /iV), ITheorem 4.11 follows. 



Proof of ILemma 4.21 (Recovering e m - Well-supported Nash from Bimatrix Game): Let (x,y) 
be an e2-well-supported Nash equilibrium played in G2, and let (yVHy 1 !!, . . . , y m /\\y rn \\) be a mixed 
strategy profile played in G m . We show that this mixed strategy profile is actually an e m - well-supported 
Nash equilibrium of G m . 

For every player i of G m , we define an injective function hi : [th] —5- [N] to be hi(j) = Xli'<i n «' +i- 
So hi maps the j'th pure strategy of player i in G m to the j'th pure strategy in block i of player 1 in 
G2. We now show that player i's expected payoff for playing j in G m is closely related to player l's 
expected payoff for playing hi(j) in G2, assuming strategy profiles (x,y) and (y 1 /!!!/ 1 !!, . •• , y m /||y m ||) 
are being played in G2 and G m , respectively. In fact, the expected payoffs are the same up to shifting 
by ck Hi/* || (the contribution from the diagonal of player l's payoff matrix A), scaling by m (the number 
of blocks on which y is uniformly distributed), and small additive errors. As in lSection 3[ the fact that 
the expected payoffs are preserved, even up to shift and scale, is enough for one game's e- well-supported 
Nash equilibrium to imply the other's. 



Claim 4.6 (Expected Payoffs are Preserved up to Shift and Scale) u' G [j] 

a\\y i \\)±m 2 (l + e 2 )/a. 



m-{uhjhi(j))+ 



Proof: By construction of matrix A, player l's expected payoff vector for playing pure strategies in block 
i is A l,l y l + Y^i'^i M 1 ' 1 y l ■ The entries of vector A % ' % y l are — a||y*||, and the sum Ylv^i M 1 ' 1 y l equals 



3 Note that every em/N(a + l)-well-supported Nash equilibrium of the normalized game is an e m /N- well-supported 
Nash equilibrium of the unnormalized game. 
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y 1 II ■ Yli'^i M 1 ' 1 y l IWy 1 || = ||y J || • u G . By Corollary 4.5, and since (x,y) in an e2-well-supported 



Nash equilibrium of G 2 , player 2's weight is distributed evenly over the m blocks up to (1 + €2) /a. It is 



not hard to see that Corollary 4.5 implies, for every i' £ [m], that \\y* \\ = l/m±(l + e 2 )/a. Plugging in, 
we get that entry hi(j) in player l's expected payoff vector is u G Jhi(j)] = —a\\y % \\ + (l/m± (1 + 62) /a) ■ 
u G [j]. The proof is complete by noting that player i's expected payoff u G [j] in G m is bounded by 
m, and by rearranging. ■ 

It's left to show that preservation of expected payoffs for playing hi(j) and j up to shift and scale 
is enough to ensure that (y /\\y \\, . . . , y m /||y m ||) is an e m -well-supported Nash equilibrium of G m . 
More precisely, we show that if pure strategy hi(j) is an e 2 -best response for player 1 in G2, then pure 
strategy j is an e m -best response for player i in G m . We can then invoke IClaim 4~3l by which player 
2 only plays pure strategies that are e2-best responses for player 1, and conclude that mixed strategy 
2/*/ 1 1 2/* II contains only e m -best responses for player i in G m . 

Assume for contradiction that j is not an e m -best response for player i in G m . Then there exists 
another pure strategy j' E [m] such that u G [j] < u G [j'] — e m . But by IClaim 4."6l this implies 
u G2 [hi(j)] < u G2 [hi(j')] + 2m(l + e 2 )/a - e m /m. By choice of e 2 and a, e 2 < e m /m - 2m(l + e 2 )/a. 
Thus, hi(j) cannot be an e 2 -best response for player 1 in G 2 , contradiction. This completes the proof 
of ILemma 4.21 ■ 

5 A Logarithmic- Sized Linear Multiplication Gadget 

In this section we prove ILemma 2.31 by showing an alternative contruction of a linear multiplication 
gadget. The main difference from the construction shown in ISection "21 is that the unary encoding is 
replaced by binary encoding. However, this introduces a new difficulty, since every gadget that performs 
binary bit extraction is inherently brittle, i.e., its output is arbitrary for certain inputs. We use the 
bit extraction gadget of |DGP09] , and overcome the brittleness using standard methods of averaging 
(somewhat simplified by introducing a new median gadget). 

5.1 Linear Gadgets 

We introduce several linear gadgets that will be useful for the construction. Additional gadgets that 



are known from previous works can be found in Appendix A Throughout, we denote the input, output 



and auxiliary players of a gadget by Pi, ... , P m , P, W, W\, . . . ,Wi, and the values they represent by 
pi,...,p m ,p,w,wx,...,wi. 

The following gadget G mas k treats its first input as a binary mask for its second input (i.e., performs 
multiplication between a binary input and an arbitrary input while maintaining linearity). Furthermore, 
it guarantees that if the second input is close to zero, the output will be close to zero as well. 

Lemma 5.1 (Linear Mask Gadget) There exists a linear gadget G mas k such that in every e-well- 
supported Nash equilibrium: 

p 2 ±e if px = 1 

if Pl = 

0±3e ifp 2 =0±2e 

Proof: Nonzero payoff matrices: 

M P,W = I l ° j M W,P ^ I 







Expected payoff vectors: 
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• u w = M w > p p p + M w ^p p ^ + M W ' P *p P2 = (p + 2(1 -pi),p 2 ); 

• u p = M p > w p w = (l-w,w). 

Assume G mas k is in e-well-supported Nash equilibrium. First we show that p\ is a binary mask for p2- 
If pi = 0, the only e-best response for player W is 0, and so w = and also p = (actually this holds 
whenever p\ < 1/2). If pi = 1, player W's expected payoffs for playing strategies and 1 are p and p 2 
respectively. We claim that p must be equal to p 2 up to ±e. Indeed, if p > p 2 + e, to = and so p = 0, 
contradiction. Similarly, if p < p2 — e, w = 1 and so p = 1, contradiction. 

It is left to show that if p2 is close to zero then p is also close to zero. Assume for contradiction that 
P2 < 2e and p > 3e. Pure strategy 1 must be an e-best response for P, therefore w > (1 — w) — e. So 
pure strategy 1 must be an e-best response for W, therefore p2 > p + 2(1 — p{) — e. Plugging in we get 
2e > p2 > p + 2(1 — pi) — e > 3e + 2(1 — p{) — e = 2e + 2 — 2p\. This implies that p\ > 1, contradiction. 
■ 

Lemma 5.2 (Linear Max Gadget) There exists a linear gadget G max such that in every e-well- 
supported Nash equilibrium, p = m&x{pi,p2} ± 4e. 

Proof: The construction is by combining gadgets: 



'1 


= G < (p 1 ,p 2 ) 


'2 


= GL(p 2 ,pi) 


! 3 


= G mask (wi,w 2 


P 


= G+,*i (io 3 ,pi) 



The correctness follows almost immediately from the guarantees of the combined gadgets (see lLemma 2.91 
ILemma 5.1| ILemma A. 11 ILemma A.2p . The idea is to set the output p to be approximately equal to 
^l (P2 — Pi) +Pi, where w\ is an indicator whether p\ < P2- Assume G max is in e-well-supported Nash 
equilibrium. If p\ < p2 — e then w\ = 1, and so p is approximately equal to pi- Similarly, if p\ > p2 + e 
then w\ = 0, and so p is approximately equal to p\. In the case that \p2 — p\\ < e, W\ may receive any 
arbitrary value, but ui2 < 2e and so by the guarantee of G mas k, W3 < 3e. The product w\ (p2 — pi) is 
calculated by G mas k in order to maintain the linearity of the construction. ■ 

Lemma 5.3 (Linear Min Gadget) There exists a linear gadget G m i n such that in every e-well-supported 
Nash equilibrium, p = mm{pi,p2} ± 8e. 

Proof: The construction is by combining gadgets: 



W\ - 


-- Gi-sfri) 


W2 ~- 


= Gi- X (p 2 ) 


W 3 ~- 


= G niax (wi,w 2 


P ~ 


= Gi- X (w 3 ) 



The correctness follows immediately by the guarantees of the combined gadgets (see lLemma 5.2ULemma A.3j) . 
■ 

Lemma 5.4 (Linear Median Gadget) There exists a linear gadget G ma n a n such that in every e- 
well- supported Nash equilibrium, p = median{p±,p2,P3} ± 20e. 
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Proof: The construction is by combining gadgets: 

wi = G max (p 1 ,p 2 ) 

W 2 = G m i n (j)i,P2) 
W3 = Grain fe^l) 
P = G max (u;2,W3) 

Assume G me dian is in e-well-supported Nash equilibrium. We use the following notation to prove cor- 
rectness: s = min{pi,p2,P3}, m = median {pi,P2,P3} and / = m&x{pi,p2,P3}, such that s < m < I. 
The values W2 and W3 are equal to two of the three values {pi,P2,P3} = {$, m, I}, up to an error of ±12e 
introduced by the maximum and minimum gadgets. To see this, notice that if w\ = Pi^n.2} ± 4e, then 
W2 = p J ' e {i i 2} J yj±4e and W3 = min{j»3,pj ± 4e}±8e (bv lLemma 5.2l and lLemma 5.3|) . Now, if m < I— 4e, 
both u)2 and ^3 must be strictly smaller than I, so the two values they are approximately equal to must 
be s and m. Taking their maximum therefore results in the median value: maxju^,^} = m± 12e, 
and so p = m ± (12e + 4e) (jLemma 5.2j) . If, however, m > / — 4e, then W2 and W3 are approximately 
equal to either {s,m}, {s,l} or {m,l}. Taking the maximum of {^2,^3} therefore results in either 
m ± (12e + 4e) or I ± (12e + 4e) = m ± 20e. ■ 

5.2 Brittle Construction 

We first construct a brittle multiplication gadget denoted by G*. Let /3 = \ log(l/e) be a parameter 
of the construction (assume for simplicity that /3 is integral). The output p of G* is guaranteed to be 
P1P2 =t 0(y/e), but only as long as the input p\ is far enough from any integer multiple of 2~@ . For 
every 1 < i < f3, let Bi,Si,Wi be auxiliary players representing values bi,Si,Wi respectively. G* sets 
b\ , . . . , b/3 to be the /3 most significant bits of input pi using the bit-extraction gadget Gbit (ILemma A.6|) . 
Then, G* calculates P2 J2i=i (^2 - *), which equals P2 {pi ± 2 _/3 ). The calculations are carried out in 
the following order: 

• The values {y^"*}^ r fl , are calculated using the scaling gadget G^ (jLemma A.5p . i.e., Si = 

G* 2 -i(p2)- 

• For every i G [/3], P22 _i is multiplied by the extracted bit hi using the mask gadget G mas k 
(ILemma 5.TJ ). i.e., tOj = G mask (6j, Sj). 

• The values {p22 _l 6j}j G r^ are summed up using the summation gadget G + = G +) *i ([Lemma 2.9|) . 
i.e., p = G+^i,...,^). 

5.3 Correctness of Brittle Construction 

Lemma 5.5 Let p\,P2 be the input values of G*. If pi is 3/3e-far from every integer multiple of2~", 
then in every e-well-supported Nash equilibrium where e < jttj, the output value p equals p\P2 ± 2-^/e. 
The size of G* isO(f3). 

Proof: First observe that since ft = \ log(l/e) (i.e., 2~@ = y^) and e < j^, it holds that 2 • 3/3e < 2 _/3 , 
and so p\ can indeed be 3/3e-far from any integer multiple of 2~@ . We write p\ as p\ = Yji=i b*2~ l + 5, 
where 3/3e < S < 2~@ — 3/3e. Assume G* is in e-well-supported Nash equilibrium where e < yp-. By 
ILemma 5.1( ILemma A. 61 and ILemma A. 51 we know that for every i € [/3] : 

h = b* 

Si = p 2 2~ i ±e 

Wi = sA ±e = p 2 2~ i b* ± 2e 
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By Lemma 12.91 and the value of 5: 



p = mm 



1 

i=l J 

min J 1, £ {P22~ l b* ± 2e) 1 ± e 

min J 1 >P2 ^ (2"*&?) ± 2/3e I ± e 
min{l,p2 (pi — <5) ± 2/3e} ± e 



Plugging in /3 = ^log(l/e), we get that p = p\P2 ± 2-y/e, as required. Size of G*: The bit-extraction 
gadget Gbit requires 0(/3) vertices (jLemma A.6j) . and the number of auxiliary vertices {Si} and {Wi} 
is also 0(/3). The other gadgets are of constant size. ■ 

5.4 Robust Construction 

When p\ is close to a multiple of 2 _/3 , G*'s output may be arbitrary. To circumvent this issue, the 
ultimate multiplication gadget G* applies G* three times, each time with a slightly perturbed copy of 
the input p\. The perturbation guarantees that at most one of the three copies of p\ is close to an integer 
multiple of 2~", so that at least two of GVs three outputs are approximately correct. The difficulty 
is that we don't know which of the three outputs is approximately correct and which is arbitrary. We 
overcome this difficulty by taking the median of the three outputs as the final result, which is now 
guaranteed to be approximately equal to the required output p\pi- 

The inputs to G* are set to be (up to ±0(e)): (pi,P2), (fi — A,p 2 ) an d (pi — 2A,j>2), where p~\ = 
maxjpi, 2 A} and A = 7/3e. This is achieved by combining the following gadgets: 

• First, the value of p± is set: c\ = G := (2A + 7e),p\ = G max (pi,ci). 

• Then, two additional inputs are prepared: C2 = G := (A),C3 = G-=(2A),di = G_(pi,c 2 ),d 2 = 
G-(p~i,c 3 ). 

• G* is applied: w± = G*(p"i,p 2 ), tt> 2 = G*(di,p 2 ),^3 = G*(<i 2 ,p 2 ). 

• The median is found: p = G rae< n a ,n(wi,W2,ws)- 

5.5 Correctness of Robust Construction 

Proof of ILemma 2.31 (Logarithmic-Sized Construction): First note that G* is a combination of 
linear gadgets and is thus itself linear. The size of G* is 0((3) = 0(log -), since the brittle multiplication 
gadget G* requires 0(/3) vertices (jLemma 5.5[) . and the number of other auxiliary vertices is constant. 

Assume G* is in e- well-supported Nash equilibrium where e < y^-. By the gadget guarantees we know 
that p\ > 2A + 2e, and that d\ = p\ — A ± 2e and d>2 = p~\ — 2A ± 2e (ILemma 5.21 ILemma A. 21 and 
ILemma A.4p . Since e < -^ , A = 7/3e and P = \ log \ , it can easily be verified that p\ > d\ > d 2 > 
and that the distance between each consecutive pair is A ± 4e. 



Claim 5.6 At most one of pi,d±,d2 can be 3(3e-close to a multiple of 2 



-P 



Proof: Since the distance A±4e is larger than 2-3/3e, if one of pi, d\, d 2 is 3/3e-close to a certain multiple 
k2~@ , then the other two must be 3/3e-far from k2~@ . Furthermore, since the distance is smaller than 
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(2 P — 2 • 3/3e)/2, the other two must be 3/3e-far from the nearby multiples (k — 1)2 " and (fc + 1)2 ^ 
as well. ■ 

Bv lLemma 5.51 and IClaim 5.61 at most one of w±, W2,W3 can be arbitrary. There are two cases: 

• The median is not the arbitrary value. Assume without loss of generality that the median is W3 
(since it is the furthest from p\P2)- Bv lLemma 5.41 and ILemma 5.51 

p = W3 ± 20e 

= d 2 p 2 ± (2^/e + 20e) 

= pip 2 ± (2Vi + 2A + 22e) 

• The median is the arbitrary value. Assume without loss of generality that the non-arbitrary values 
are W2 and W3 (the furthest from p\P2)- The median is between these values, so we may assume 
without loss of generality that it is equal to W3, and proceed as in the previous case. 

We have seen that in both cases, p is close to p\p2- It is now left to verify that p~\ is close to p\. 

Claim 5.7 p\ = Pl ± (2A + lie). 

Proof: If max{pi,ci} = p\ then p\ = p\ ± 4e (ILemma 5.2j) . Otherwise, < p\ < c\ = 2 A + 6e ± e 
(ILemma A.4p and p~\ = c\ ± 4e. ■ 

We conclude that p = pij>2 i (2\/e + 4A + 37e) = P1P2 ± 3^/6, as required. ■ 
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A Standard Gadgets 

The following gadgets are constructed by Daskalakis et al. [DGP09J . We denote the input and output 
players by Pi, P2,P, and the values they represent by pi,P2,P- 

Proof of ILemma 2.81 (Linear AND Gadget): 

Nonzero payoff matrices: 

M p > Pl = M p > p > =( ™ 

V ° 

Expected payoff vectors: 

• u p = M P '*V + M P ' P2 p 2 = (3/4, (pi +p 2 )/2). 

Assume G >( j is in e- well-supported Nash equilibrium where e < 1/4. If pi = P2 = lj the only e-best 
response for player P is pure strategy 1, so p = 1. Similarly, if (pi = 0) V (p2 = 0) then p = 0. ■ 

Proof of ILemma 2.91 (Linear Scaled-Summation Gadget): 

Let Pi, . . . , P m , P,W be the input players, output player and auxiliary player of G +: ^ respectively, 
representing values pi, . . . ,p m ,p, w. Nonzero payoff matrices: 

M w > p =(ll) ,M W ^ =(l°) ,M P > W 
Expected payoff vectors: 

. u ™ = M^p p r + E m^p* = (p, c £ i6[m] Pi); 




u 



P — T\/rP,W n W 



M p > w p w = (l-w,w). 



Assume Cr+ *f is in e- well-supported Nash equilibrium. If player W plays full support (0 < w < 1), 
then both of W's pure strategies and 1 must be e-best responses, and so p = u w [0] = u w [l] ± e = 
C Siefml P« ^ e ' as required. If u> = 0, the only e-best response for player P is pure strategy 0, so p = 0. 
Similarly, if w = 1 then p = 1. Case analysis: 

• e < CSieM-P' < 1 — e: Assume for contradiction that W does not play full support. Without 
loss of generality, assume w = 1. But then p = 1 and tt^fO] = 1 > ( J2ie\ m ] Pi + e = u w [l] + e, 
contradiction. Similarly, w = leads to contradiction. 

• C^2i£\ m ]Pi < e: Player VF can either play full support or pure strategy (if w = 1 then p = 1 
and the only e-best response for W is pure strategy 0, contradiction). If w = then p = = 
C Z)i 6 [m] Pi ± e ' as required. 

• C Siefml Pi > 1 — e: Similarly to the previous case, W can either play full support or pure strategy 
1, and if w = 1 then p = 1 = min{l, £ X^eM Pi} ^ e i as required. 



Lemma A.l (Linear Comparison Gadget) There exists a linear comparison gadget G < of size 
0(1), such that in every e- well- supported Nash equilibrium, p = 1 if p\ < P2 — e and p = if p\ > P2 + e. 

Proof: Nonzero payoff matrices: 

M P ' Pl = 
Expected payoff vectors: 




P,P2 
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• u p = M P > P V + M p > p *p 2 = (pi.pa). 

Assume G < is in e-well-supported Nash equilibrium. If pi < P2 — e, the only e-best response for player 
P is pure strategy 1, so p = 1. Similarly, if p\ > P2 + £ then p = 0. ■ 

Lemma A. 2 (Linear Minus Gadget) There exists a linear subtraction gadget G_ of size 0(1), such 
that in every e-well-supported Nash equilibrium, p = max{0,p2 — Pi} ± t. 

Proof: Nonzero payoff matrices: 

M w > p =(ll) ,M w > p i = (° _° J ,M^ P * = (^ o 1 ) ,MP ' W = 

Expected payoff vectors: 

• u w = M w ' p p p + M w - P ^p 1 + M w ' p *p 2 = (p,p 2 - Pl ); 

• u p = M pw p w = (1 - w, w). 

Assume G_ is in e-well-supported Nash equilibrium. As in the proof of ILemma 2.91 it is not hard to 
show that either player W plays full support (so both of W's pure strategies must be e-best responses 
and p = P2 — Pi± e), or one of the following happens: 

• P2 — Pi > 1 — e: Player W can play pure strategy 1, and then p = 1 = p 2 — p\ ± e, as required. 

• P2 —p\ < e: Player W can play pure strategy 0, and then p = = max{0,p2 — Pi} ± e, as required. 



Lemma A. 3 (Linear Complementary Gadget) There exists a linear complementary gadget G\. 
of size 0(1), such that in every e-well-supported Nash equilibrium, p = 1 — p± ± e. 

Proof: Nonzero payoff matrices: 

M W > P =( G ,M W ^=[ ),M P > 1 






Expected payoff vectors: 

. u w = M w ' p p p + M w ^p x = (p, 1 - Pl ); 

• u p = M p - W p w = (1 - w, w). 

Assume G\- x is in e-well-supported Nash equilibrium. As in the proof of ILemma 2.91 it is not hard to 
show that either player W plays full support (so both of W's pure strategies must be e-best responses 
and p = 1 — pi ± e), or one of the following happens: 

• 1 — p\ > 1 — e: Player W can play pure strategy 1, and then p = 1 = 1 — pi ± e, as required. 

• 1 — pi < e: Player W can play pure strategy 0, and then p = = 1 — p\ ± e, as required. 



Lemma A. 4 (Linear Assignment Gadget) For every rational Q G [0,1], t/iere exists a linear as- 
signment gadget G-^ of size 0(1), such that in every e-well-supported Nash equilibrium, p = £ ± e. 



Proof: Nonzero payoff matrices: 




M w > p = \,M P ' W 




Expected payoff vectors: 
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. u w = M w ' p p p = (p,C); 

• u p = M p > w p w = (l-w,w). 

Proof of correctness as in ILemma A.3I ■ 

Lemma A. 5 (Linear Scaling Gadget) For every rational ( S [0,1], there exists a linear scaling 
gadget G^ of size 0(1), such that in every e- well- supported Nash equilibrium, p = £pi ± e. 



Proof: Nonzero payoff matrices: 

00/' V C ) ' I 



M W,P = » 1 ,M^.= ° M.M^-' 1 ° 



Expected payoff vectors: 

• m w = M w ' p p p + M w ^p x = (p,<pi); 

• m p = M p > w p w = (1 - w, w). 

Proof of correctness as in ILemma A. 31 ■ 

The following gadget has multiple output players, denoted by B\,...,Bp and representing values 
bi,...,bp. It extracts the first /3 bits of its input, provided the distance of p\ from any multiple of 
2~P is at least 3/3e. 

Lemma A. 6 (Linear Bit Extraction Gadget) For every integer (3 > 0, there exists a linear bit 
extraction gadget Gut °f s ^ze 0(f3), such that given input p\ = X/ieWl K^~ l + ^ where 3/3e < 5 < 
2 - ^ — 3/3e, in every e- well- supported Nash equilibrium where e = O (2 _ (^ +log ^)), b% = b* for every 

Proof: The construction is by combining linear gadgets: 

x\ = G- (pi) 

Mi : bi = G >2 -i (xi) 

Mi : Wi = G* 2 -« (bi) 

Mi : Xi+i = G_ (xi,w) 

The correctness follows from the guarantees of the combined gadgets, and by induction on i. See 
[DGP091 Lemma 19] for details. ■ 
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